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INTRODUCTION 



Facultie^> in the Great Lakes Colleges Association rightly pride them- 
selves on gieat teaching, intense concern for the student as a person, and 
depth of scholarship. What contribution then could so franldy empirical 
and pedagogical a project as the Programed Instruction Project make to 
teaching and learning in such colleges? Do programs teach at the college 
level? If so, under what conditions? Are programs as effective as time- 
honored methods now in use? Do programers become better teachers? 

This report was written to answer these questions. The project allows 
us to see possibilities and potentials that lie beyond some of our present 
understandings and practices of teaching — ^possibilities that any teacher 
who is seriously bent on self-improvement will find both intriguing and 
exciting. 

One outstanding feature of the project was the wid^pread participa- 
tion of faculty members and administrators in the Association. All twelve 
colleges participated in the project. An estimated 200 faculty members 
(about fifteen percent of the total GLCA faculties) were directly involved 
in the project through conferences, preparing programed materials, field 
testing and evaluation programs, or through contacts with the director. All 
faculty members were alerted in varying degrees to new media of instruc- 
tion. 

A second outstanding feature was the intensity with which a number 
Oi persons participated in the project. The Liaison Committee^ actively 
advised the director and formulated policies under which the project was 
administered. In addition, 42 programekS prepared materials after receiving 
intensive training in the principles and procMures of programing. Five of 
them received further concentrated training, and became consultants and 
editors for other programers. More than two dozen faculty members par- 
ticipated in the evaluation ®f GLCA programed materials and were given 
brief but intensive instruction in procedures of conducting reccarcho 

A team effort characterized the Programed Instruction Project, carry- 
ing it forward from conception to conclusion. A conference of reprcsenta* 
tives from the colleges created the project. Colleges contributed both human 
resources and facilities to the project. From faculty members and ad- 
ministrators came ideas that significantly enriched its ends and means. 

The Programed Instruction Project was the first GLCA association- 
wide project. It originated in an authorization of the Board of Directors in 
January, 1962, which approved the formulation of a pro^sal for a project 
to produce and evtduate programed instructional materials at the college 
level. A conference was called in March, 1962, where the potential of pro- 
gramed instruction for college teaching was discussed witb particular 
reference to experiences already gained at Antioch, Earlham, and Oberlin 



1 A complete technical report of the project can be found in each GLCA college 
library. See Appendix A for the names of the colleges. 

^ Names of members of the Liaison Committee are found in Appendix A. 
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Colleges. The conference produced a series of agreements about the nature 
of the prosposed project and the first draft of a proposal was authorized by 
the Board. Dr. Daniel Smith of Earlham College, with some assistant of 
other conferees, essumed responsibility of formulating the final draft o 
the proposal. 

The GLCA Research Committee, consisting of Chairman S^uel 
Baskin, Antioch College; Paul Carnell, Albion College; Robert De Daan, 
Hope College; and Celeste McCullough, Oberlin College, t«e 

proposal to the U.S. Office of Education in March, 1963. The Office of 
Education accepted the proposal for support and funded it in the summer 
of 1963 under Public Act 85-864 Title VII, Part B, Dissemination Activities 
Concerned with the More Effective Utilization of Media for Educational 
Purposes. The original contract began on June 27, 1963, and ran through 
June 27, 1965. The contract was extended to June 30, 1966. 



PUBPOSES OF THE PROJECT 



The purpose of the project were five: 

1. To develop programed instructional materials for college level teaching. 

2. To evaluate existing commercial programed materials. 

3. To evaluate and compare uses of programed instructional materials 
and thereby to discover where they nt into the curriculum. 

4. To promote basic research and instruction and to evaluate the broader 
effects of programed instruction. 

5. To disseminate the results of the project. 
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WHAT IS PROGRAMED INSTRUCTION? 



A program is a set of items® selected and ordered in such a way that 
a student, working through the set, can gain optimal attainment of the 
stated objectives. A program is relatively selMnstructional; it constantly 
calls upon the student to respond. Programed instruction has more to do 
with the method than with the content of teaching. 

There are no a priori rules governing the format of the program or 
the medium of presentation. Items may conceivably be as small as a word 
or large as a page. They may be written, tape recorded, or sketched by an 
artist. They may be printed and bound together in book form, typed on 
3 X S cards and packed into recipe boxes, or adapted for computer as* 
sisted instruction. 

A program is probably the most sophisticated attempt to date to bring 
together three essentials of good instruction: Objectives stated in terms 
of observable student performance? content presented in suen a way that 
the student by working through it achieves the objectives; and criterion 
tests which ascertain the extent to which the student actually attained the 
objectives. 

Below is an example taken from a program that was prepared on the 
Programed Instruction Project. The objectives are given first and are ex- 
pressed in terms of observable student performances. The objectives com- 
municate to the student what he can expect to learn from using the program. 



POETRY, METHOD AND MEANING; A PROGRAM IN 
POETIC ANALYSIS AND CRITICISM 

James W. Cook, Department of En^sh, 

Albion College, Albion, Michigan 

General Objectives: 

1. Student should use critical vocabulary when writing, thinking, or talk- 
ing about poetry. 

2. Student should identify figures of speech and thought when th^ occur 
in a poem. 

3. Student should be able to analyze and specify^ the contribution of 
figures of speech and thought to a poem’s meaning. 

4. Student should be able to posit multi-level interpretations of a poem. 

Courses for Which Intended: 

Introduction to Literature or any course in which poetry, especially lyric 

poetry, is to be a primary concern. 



3 An item is a variable amount of material which serves as a stimulus unit to which 
the student is asked to respond. An item is sometimes called a “frame” because in 
some early programs it was presented as a frame in a teaching machine. 
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Topics Covered: 

Bcsic poetic figures of speech and thought and_ the concepts of metaphor, 
symbol, and image as they interact and contribute to the meaning of a 
total poem. 

Approximate Time Required: 

Four to eight hours. 

Prerequisite Knowledge: 

Freshman or sophomore college standing or advanced high school student 
without previous experience. 



Here is a sample page from a later section of the same program. Note 
how item 51 begins to help the student attain the second objective of the 
program — ^to identify figures of speech and thought — although the student 
ssiWfet gc much further in the program before he wiL attain the objective 
fully. 
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51. Images constitute another very important class of 
figures of speech. One might say that an image results 
when a passage is so vividly descriptive that the reader 
imagines a sensory experience. For example: ‘T^e 
smooth and creamy vanilla ice cream, cool upon my 
tongue, melted gently toward my tonsils.” Now, while 
you really can’t taste the ice cream nor feel its texture 
or its temper ature, you can imagine that taste and 
that feeling. 

Try it! Got if? Yum! 

Thus, an image is a figure of speech that reprereats a 
concrete ^perience or an object by appealing to the sences 
through the 



imamnation 



A poet may appeal to sight, hearing, smell, taste, touch, the senses which dis- 
tinguish changes in temperature, which register balance and motion, and which 
register visceral reactions. For our purposes, include the last three under touch. 



Below is page 37 from the same program. By referring again to the 
<ibjeetives of the program, the reader can see that items 52 and 53 are meant 
to further the student’s achievement of the second objective. 



37 

52. Which of the following quotations contain images? Circle the appropriate 
letters. 

A. All in a hot and copper sky 

The bloody sun at noon 
Right up above the mast did stand 
No bigger wian the moon. 

B. Grow old along with me. 

The best is yet to Ls. 
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I cannot see what flowers are at my feet. 

Nor what soft incense hangs upon the houghs. 
But, in embahned darkness, guess each sweet 
Wherewith the seasonable month ^dows 
The grass, the thicket, and the fruit tree wild; 
'\l^ite hawthorn and the pastoral e^antine. 
Fast fading violets cover’d up in leaves 
And mid'May’s eldest child. 

The coming musk-rose, full of dewy wine. 

The murmurous haunt of flies on summer eves. 



S3. 



You should have circled A and C. 

Observe that the tied images in A and C are such that Act CToke virtually 
Ae same imaginative responses in most readers. Look back at A and C 
and analyze your responses. To which seUi^es do the tied A and 

C appeal? (They may appeal to more than one.) List Aem. which words 
seem to control that appeal? 

Senses ^ords 




What follows below is an example of some criterion test questions de- 
signed to ascertain the extent to which the student has attained the first two 
objectives of ihe program. The test can be used as a pre-test to detCTmme 
how mucia the student already knows of what the program can teach. The 
instructor has the option of excusing the student from those parte of the 
program t^t he already knows. Or the test can be used as a final test of 
achievement. 
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Pre- or Post-Test 
(Form 1) 

In your own words, define and give two or three examples of Uterary 
convention. 

Image and Symbol 

1. In your own words, state your concept of an image. 

2. What is a tied image? 

3. What is a free image? 

4. What is a synaesthetic image? 

The following list contains the names of figures of speech often 
employed by poets: 

5. Hyperbole 

6. Synechdoche 

7. Conceit 

4. Apostrophe 8. Metonymy 

The passages which follow contain one or more examples of each of 

these figures. Bj ’ ' * " " ' * 

match the name 

A. 



Metaphor 
Simile 

Personification 
Apostrophe 



^ wmen lOIlOW UUllUtUl UUC U* muxe «#Aaaaa|aa\^ w* w 

these" figuii^. By placing the number before the appropriate letter, 
ne of the figure with the underlined example. 

Love bade me welcome; yet my soul drew back 
Guilty of dust and sin. 
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JB. But quick-eyed Love, observing me grow slack 
,C. From my firat entrance in, 

J). Drew nearer to me, sweetly questioning 
,E. If I lacked anything. 

JF. My Shakespeare, rise; I wOl not lodge thee by 
Chaucer or Spenser, or bid Beaumont lie 
a little further to make thee a room; 

-G. thou art a monument without a tomb 



Programs and Traditional Teaching Media 

Programed instruction is similar at some points to expository teaching 
and at otkijr points to extemporaneous^ teaching, as found in some class- 
rooms and in discussion groups. Both programed instruction aim ex- 
pository lectures are pre-designed, both can be planned deliberately before 
they are used. But there are also differences. A lecturer places greater 
emphasis on the content of a lecture and relatively less enaphasis on his 
objectives or on assessing the students’ attainment of objectives than does 
a program writer. In an expository lecture the lecturer tends to assume 
that what is taught is learned. On the whole, a lecture tends to be a more 
flexible teaching instrument than is programed instruction, but by the 
same token tends also to be less precise. 

In extemporaneously designed learning the conditions of learning are 
created on the spot as instruction proceeds. The emphasis is on the process 
of interaction, not on precisely what is learned, as is true of programed 
instruction. That is, the outcomes of learning are less focal than the 
process. Although discussion is a highly flexible instructional instrument, 
its outcomes are hard to evaluate. In common with pro^amed instruction, 
however, extemporaneous teaching emphasizes the importance of the 
learner’s activity. Discussion seems to lead the learner toward ra^er dif- 
ferent objectives from those typically found in programed instruction. 

A textbook is designed largely as a reference work. It is logically or- 
ganized. Content is emphasized. Practically the only way students can 
interact with the material beyond simply reading it is to underline parts 
of it. 

A program is designed as an instructional device engaging the student 
m a dialogue, which althou^ perhaps crude, is analogous to a tutorial 
relationship. The requirements for the student’s interaction are more in- 
tense than for a textbook. 

The feeling of frustration expressed by some students who used pro- 
gramed materials may have come from their reading the program like a 
textbook instead of interacting with it. Learning by me^ms of a program 
takes the same kind of concentration that taking a standardized test requires. 

Origins of Programing 

Although the beginnings of programed instruction can be traced to the 
decade of the twenties and the teaching machines of Sidney Pressey, general 



4 Robert Gagne, The Conditions of Teaching, New York; Holt, Rinehart Winston, 
1965, pp. 259-251. 
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interest in programed instruction did not crystalize until the middle fifti^ 
when Professor B. F. Skinner, drawing upon the results of ejqperiments m 
animal learning, devised programs using “operant conditioning, a term 
which has been used to describe his model of learning. T^is model empha* 
sizes the following principles of learning which were applied to programing 
in its early stages: The necessity of a student’s actively responding (fit- 
ting behavior to be “shaped”), presenting the material to^ be learned in 
a tnflll steps, immediately reinforcing correct re^onses, reducing the nunwer 
of errors a student made in learning the material, and allowing the student 
to proceed through the program at his own rate. 

The Programed Instruction Project, however, took a new look at pro- 
gramed instruction. Programers discovered not only that n^ programs 
can be made more sophisticated than many of the early ones, but al^ that 
programs based on a problem-solving or discrimination m^el of human 
thinking are more suitable for college students than those that drav/ tfeeir 
major principles from animal learning. The new species of progranp re- 
quire the student to discriminate among perceptual and cognitive stimuli 
and -do not require immediate reinforcement of his responses. The new 
pro ble m solving programs grow out of information and cognitive theory 
rather t han operant conditioning. Programs based on the operant condi- 
tioning model, on the other hand, were desired to lead the student to the 
solution or the principle without his necessarily being ®onsciously aware of 
arriving there. 

According to this new concept of programing the task of the programer 
is to establish conditions in which concepts, principles, solutions to problems 
can be created or discovered by the student from the raw nwterials of 
data, information, problems presented to him in the items^ of the program* 
Inductive problem solving, the mode of the new programing, proydes the 
necessary raw material and a mimmum of clues to help^ the student, but 
^lln wa him to discover his own generalizations and conclusions. 



FBEFABING FROGRAMED INSTRUCTIONAL 

MATERIALS 



The preparation of problem-solving programed instructional materials 
casts new light upon the process of instruction. Programing exposes for 
examination many aspects of learning and teaching to which the programer 
may have previously been indifferent or blind — especially behavioral ob- 
jectives, strategies of learning, evaluation of outcomes. For example, the 
process of writing the first item of a program brings into focus the learning 
problems that students face in adopting the frame of reference required by 
the instructor. Until one writes a program he may easily shift the re- 
sponsibility of this requirement to the student. By committing his instruc- 
tion to a program, the programer can more easily see his own responsibility 
to adapt his teaching to the learner’s frame of r^erence. 

Preparing a program is akin to making a slow motion film of a base- 
ball pitcher’s delivery. Learning processes that usually occur swiftly, to be 
lost forever, are captured in the process of programing. A teacher, under 
ordinary classroom conditions, may explain a point and hurry on, failing to 
see the momentary blank look of a student. The failure of an explanation 
can be seen in a program, however, when students stumble again and again 
over a weak item. 

It is next to impossible for an instructor to obtain detailed and im- 
mediate feedback on the efficacy of other modes of teaching. On the prmect, 
however, programers tested their materials regularly with volunteer students 
as they wrote the programs. Such feedback not only improved the pro- 

S tns but also allowed the programer to observe how hard some students 
to struggle to understand ideas which he had written in his most bril- 
liant style. Programing highlights the value of such feedback. 

Most importantly, preparing a program forces an instructor to lay out 
for himself, ms colleagues, and Ins students what he expects students to gain 
from his program, how he expects them to attain the goals he has es- 
tablished, and what level of student performance he will accept as evidence 
that the students have attained the goab. Making such a commitment is 
rare among college teachers. 

Below is an outline of steps taken in the process of preparing pro- 
gramed materials. 

1 — formulating educational objectives in terms of observable student per- 
formance — specifying the outcomes in terms @i desired changes to 
take place in the learner — one of the essential and most illuminating 
aspects of the process of programing. 

2 — making provision for assessing the student’s progr^ toward the ob- 
jectives. The programer writes examination questions that will 
assess the student’s anticipated progress toward the objectives before 
he writes the content of the items. Examinations are treated as a de- 
rivative of the objectives rather than of the content of the program. 
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3 — selecting the content of the program in terms of the objectives and 
constructing items that contain the content The objectives spell out 
what changes the instructor desires to see take students. 

Selection of the content and writing the items then follows logically 
from the objectives. 

4 — arranging the items not in logical sequence but in a psychological 
sequence. A psychological sequence is one in which the pace, the 
amount of material, the order of presentation fite at least in some crude 
manner students’ styles of thinking and learning. As the pro^amer 
organizes his materials he does so with the student, as well as his ob* 
jectives, clearly in mind. 

5 — developmental, step-by-step testing of the emerging prcgram. Such 

testing informs the programer whether or not the material is geared 
to the student’s approach to learning as well as to the objectives 
which the program is designed to help students attain. 

The contents, the sequence, even the test questions and objectives 
of the program are revised in light of the reaction of the typical test 
subjects to the tentative sequence of items. If» for example, the ob- 
jectives of the teaching sequence turn out to be inappromiate for the 
achievement level of students for whom the materials are designed, the 
programer adjusts the goals to the level which the student can, in fact, 
attain. 

6 — the rest of the items are drafted, tried out on more students, presented 

for criticism to colleagues, and revised at every step until the proce^ 
yields the first version or “field-test” draft of the programed material. 
It is then tried out with one or more groups of students under condi- 
tions approximating those in which it will be used, "pie field test gives 
the programer information about problems of administering the pro- 
gram under normal conditions. 

The sequence of steps outlined above is not a rigid one. It does com- 
municate, hoivever, the care with which materials are prepar^ for pro- 
gramed instruction and it does suggest that more care needs to be t^en m 
the preparation of all instructional processes than may have been thought 
necessary in the past. 

Summary 

Each step has obvious connections rvith what an instructor does as 
lecturer, evaluator, discussion leader, tutor. A person may teach acceptably 
in traditional fashion for years without ever examining these connections or 
being squarely confronted with the assumptions he makes about learning 
and teaching. Writing a program in the manner described above leads a 
teacher to examine directly some of the most significant aspecte of his 
teaching processes. Preparing programed materials b one of me best ways 
yet devised for getting an instructor to look at learning rather than teaching. 

The Training Process 

Twenty-two faculty members representing all GLCA colleges received 
grants from the Programed Instruction Project to be trained to prepare 
programs during the summer of 1964.. An additional grant was split among 
four people wh > made requests for minor programs and another among 
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four librarians to produce programs for library personnel. In addition, two 
persons received half*time grants to produce programed material Uie follow* 
ing school year. 

It is sometimes asserted that the exact sciences can be programed most 
easily. Faculty members from the Great Lakes colleges, Imwever, dis- 
counted that generalization. Instructors from almost every discipline in the 
liberal arts curriculum were involved in preparing programed materials. 

The decision to train GLCA instructors in the principles and t^hniques 
of preparing programed materials was a most significant decision. The 
project was transformed thereby from a mere production-evaluation project 
to an inservice education project as well. 

Staff members of the University of Michigan provided the “new look” 
in programing and gave competent and insightful training for the GLCA 
programers during the summer of 1964, on the Dearborn campus. Twenty- 
tV 70 programs were produced and an additional three or four smaller pro- 
grams were in the making. The programers field tested these mograms dur- 
in,» the fall of 1964 and revised them on the basis of the results of the field 
tests. It took approximately two-and-one-half months, including training 
time, to prepare an average of 10 hours of programed learning material. 
Procedures, for recruitment selection and trailing of the twelve programers 
for the summer of 1965 was basically the same as for the first group of 
programers. 

Authors, titles of programs, and genera! objectives of programs can be 
found in Appendix B. 
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EVALUATION OF GLCA-PRODUCED PROGRAMS 

Skepticism about the teaching effectiveness of programed instructional 
materials runs high in most liberal arts colleges. GLCA colleg^ are no 
eTTception. It is a healthy skepticism, and it must be satisfied if predesigned 
programod materials are to make any contribution to college teaching. 

The evaluation of the GLCA-produeed programs was designed to 
answer ijuestions that were selected for their general interest per- 
^inence to the interests and concerns of GLCA faculty members about pro- 
gramed instruction. The questions one: 

— Do programs teach at all? 

— Do programs teach as effectively as textbooks or lectures covering 
the same material? 

— What classroom activities, such as question-and-answer discussions 
or Iwjtures following students’ use of the program, most effectively 
capitalize on what students have learned in the program f 
— Is the program more effective as an instrument for the acquisition 
of luiowledge or as a device for reviewing information acquired 
earlier by some other means? 

— -What effect do various motivational devices have on learning by 
programed materials versus other methods? 

Five programs produced by GLCA faculty members during the sum- 
mer of 1964 were selected for the intensive evaluation. The programs were 
the following: 

POETRY: METHOD AND MEANING, James W. Cook, Department 
of English, Albion College, .Mbion, Michigan 

LANGUAGE OF LOGIC, Morton Schagrin, Department of History of 
Science, Denison University, Granville, Ohio 
BIOCHEMISTRY FOR BIOLOGISTS, William K. Stephenson, De- 
partment of Biology, Earlham College, Richmond, Indiana 

THE LITERARY RELATIONSHIPS AMONG MATTHEW, MARK, 
AND LUKE, Robert M. Montgomery, Department of Religion, Ohio 
Wesleyan University, Delaware, Ohio 

AN INTRODUCTION TO SYSTEMATIC ANALYSIS IN POLIT- 
ICAL SCIENCE, Lois M. Pelekoudas, Department of Political Science, 
Antioch College, Yellow Springs, Ohio 

The programs were selected on the basis of their high quali^ and be- 
cause they represented each of the major divisions of the lij^eral arts cur- 
riculum-=“natural science, social science, and hamanitira. The programs 
were short ones, taking 5-12 hours of a student’s time spread over a two or 
three week period. 

The evaluation studies were designed in such a way that each of the 
five programs was c ^ aluated under four different and comparable conditions 
in an attempt to answer not only the first general question about the ef- 
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fectiveness of OTOgramed instruction, but also to answer the specidc ques- 
tions about the; conditions under which programs can best be used. In . the 
first set of studies the program was evaluated against one or more of the 
traditional methods of college teaching— classroom expository lecture, class- 
room question and answer period, or the use of a textbook. The second set 
of studies attempted to discover if a program works better when it is fol- 
lowed by a lecture or by a question and answer period. The third study 
attempted to discover whether a program is more effective when used as an 
instrument solely for the acquisition of knowledge or as a device solely for 
reviewing information acquired by some other means. The fourth study 
attempted to discover if various forms of motivation affected the students 
learning through programed materials. 

In order to qualify as a program evaluator, an instructor had to be 
teaching a course for which the program was suitable during the first 
semester of the 1965-66 school year. He had to have two sections of the 
course avail{d>le — one for experimental and one for control purposes. He 
had to be willing to devote the equivalent of 10 full days to the evaluation 
process including attendance at a workshop on experimental procedures. 
He had to be willing to follow the rigidly prescribed experimental pro- 
cedures including such things as a verbatim prescription on how to intro- 
duce the whole procedure to students, exactly how much class time to 
allow. 

A total of twenty-six instructors from eight GLCA colleges, plus one 
non-GLGA college, participated in the study. Their names are given in 
Appendix C. 

We were concerned not only to measure the amount of learning that 
occurred by means of achievement tests keyed to the programs, but also to 
assess students’ and instructors’ attitudes toward programed materials in 
comparison with other methods of instruction. Therefore, each participat- 
ing student and instructor was given an attitude questionnaire on which to 
express his opinions about various aspects of programing and other methods 
of instruction. A total of 1220 students from nine colleges and universities 
participated in the project. 

Each study used an experimental and a control group. Students were 
tested before the experiment to find out how much they knew about subject 
matter that was covered by the program and again at the end of the ex- 
periment, with a different form of the same test, to find out how much 
knowledge they gained. The same evaluation questionnaire was used by all 
students; a comparable questionnaire was used by all the evaluators. Most 
of the evaluation studio were completed in the first semester of the 1965-66 
school year. The data was processed and analyzed at the Computer Center 
of Kalamazoo College in the Spring of 1966. 

Results 

The data from the evaluation studies substantiate clearly that students 
do learn from programed materials under a variety of conditions of the 
experimental designs and as judged by the pre-and-post-test results. A sum- 
mary of the results is given in Appendix D. Also, students learned as much 
from programed material as from other methods of instruction. Students 
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who used the biochemistry program learned significantly more froTn the 
programed material than from either lectures or textbooks covering the 
same material. Thus, the first two questions raised about programed in- 
struction can be answered affirmatively. 

No evidence from the evaluation studies favored either lectures or 
question and answer discussion periods following the students use of a 
program as a means of effectively capitalizing on what students learned m 
the program. Evidence from the studies indicate that a program can be 
used as effectively either to introduce a unit of material or to review the 
material. Whether students volunteered to learn a unit of materid by 
means of a program or whether the material was a required part the 
course made no difference in the amount of learning that took place. Tnus, 
no conclusive answers can be given by this research to the last three 
evaluation questions. 

The student attitudes toward programed instruction were more posi- 
tive than negative. Their attitudes toward programs and other methods of 
instruction were compared. The order of student preference was lectures 
the most favored, then programed materials, then question and answer 
discussions, and finally textbooks. The professors conducting the studies 
expressed positive attitudes toward programed instruction following their 
participation. 

Summary and Conclusions 

The Liaison Committee, with the director, conducted a set of care- 
fully d 6 sign 6 d und ex6cut0d ©valuation studi 6 s on the effectiveness of the 
programs as teaching devices. Five outstanding GLCA^ programs were 
selected for evaluation. Five evaluation questions were raised with respect 
to the effectiveness of teaching by means of programs. The project de- 
signed research to answer each question with respect to each prograna. 
Twenty-six instructors were selected to carry out the evaluation. Each 
one had access to students for experimental and control groups. The 
project paid and trained instructors to carry out the research under as 
rigidly defined conditions as possible. Questionnaires were used to gather 
subjective evaluations of the programs by both students and instructors. 
The programers, with the consultant hel^ of colleagues, designed pre-and 
post-tests with which to measure the achievement of students, both in ex- 
perimental and control groups. 

The data were treated by analysis of variance and multi-variate 
analysis in order to answer the questions posed by the research. 

It can be stated with some confidence that college students can learn 
from programed instruction and that they and prof^sors express favorable 
attitudes toward it under conditions which prevailed in the evaluaUon 
studies. All the programs tested were as good as and one was better than 
traditional ways of instructing. 

The implication is that programed instruction is a legitimate medium 
for teaching at tlie college level. 



ANALYSIS OF WHY PROGRAMS SUCCEEDED 



Few instructors know, with any assurance, why they are successful as 
teachers, with what kinds of students they are most successful, or under 
what conditions their students learn best. The multiple correlational analy- 
sis of evaluation data of the GLCA-produced programs provided basis 
for examining answers to such questions. Success, for this analysis, was 
defined as a high score on the post tests. Nineteen variables were cor* 
rdated with post test scores. As could be expected, the programs were 
successful for different reasons. They did not work equally well with all 
students under all conditions, although they all taught as well or better than 
other methods of teaching with which they were compared. 

Students of high verbal ability (as measured by the College Entrance 
Examination Board tests), who were under-classmen, who did not spend a 
great deal of time on tfie program, were most successful with the Poetry 
program. Those who succeedra on the program tended to rate it as being 
too easy, b^t liked it better than textbooks, lecture, and discussions. 

Mdie students having high math scores on the CEEB tests were most 
successful with the ZiOgic program. Such students rated the program as a 
positive learni ng experience, were not in doubt about die direction in 
which the program was moving, and rated the program as stimulating and 
delightful. 

^ Upperclassmen did best on the Biochemistry program. No other 
variables included in the research, however, accounted for the success of 
the Biochemistry program. 

In the Religfon program, those who had not used programed materials 
before did better than those who had. The program alro favored the slower 
student to some extent. They rated the program stimulating, efficient and 
delightful, indicating further that they were not in doubt sdiout the direc- 
tion that thsj program was taking and diat the program was easy to review. 

Students with high verbal scores on the CEEB were most successful 
with the Politick Sconce, In addition, there was a significantly high cor- 
relation between being a fem^e student and succeeding on fbe program. 
Spending a good deal of time on the program was also positively correlated 
with success on the program. 

The analysis did not account for all the variables that may have pos- 
sibly been correlated with success on the program. There are many un- 
known variables about which this analysis says nothing. At best, only 
40 percent of the variance was accounted for on one of the programs; at 
the other extreme, only about 12 percent of the variance was accounted 
for on another program. These results are summarized in Appendix E. 

It is intriguing to wonder if typical teaching methods, such as lectur- 
ing and discussing, also reach only certain students and not others. If an 
instructor knew what kinds of students he reached under what conditions, 
might he not vary his methods so as to give more students a chance to 
succeed? 
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Suminary and Conclusions 

Programs succeeded with difierent kinds of students for varying 
reasons. Assuming that the programed material an instructor preppes is 
roughly comparable to his total style of teaching, the above analysis sug- 
gests the possibility that preparing one’s own programed instruction and as- 
sessing what kinds of students succeed in using it provides a procedure 
whereby an instructor can obtain objective evidence on what kinds of stu- 
dents he reaches under what conditions. 



A STUDY OF THE IMPACT OF PROGKAMING 

ON TEACHING 



The GLCA Programed Instruction Project asked more than the pro- 
duction of programs, effective as they might be as teaching devices. The 
Project sought, in the preparation of such materials, a process that would 
generate new insighte into fundamental dimensions of teachiM. If the pro- 
cess of writing programs could be made to illumine the broader domain of 
teaching, the value of the process would extend into the other teaching pro- 
cedures used by the programers. 

Programers responded to questionnaires that were used to evaluate 
the two Summer training workshops and the experience of preparing pro- 
gramed materials. Following are answeifs of the^ programers to^ a question 
which dealt with the general impact of programing. The question is; 

Judging from your experience so far, at what pointe in your total 
teaching practice is programing likely to make an impact? 

One programer answered as follows: 

I find, I am pleased to say, that I have become deeply interested in the 
possibilities which programing offers in jmy field. I have already 
thought of another subject related to my interests which has not yet 
been programed. The work this summer, although it has been taxing, 
has not been a “chore” for me, and I have looked forward to each 
day’s attempt. I had thought that completing a textbook I had planned 
to write would have been more exciting and more personally reward- 
ing; now I would hesiti .3 to say that I give most of the credit for 
this interest to the organization of the first workshop and to the follow- 
up procedures: visiting editor, outside consultants, provision for test 
subjects, etc. 

A second programer answered in the following manner: 

The experience of programing is going to make my objectives in all 
my couises much more specific and precise— —which is to say^ that pro- 
graming is a process that develops a certain kind of critical sense 
about tlie teacher’s obligation to the student. The experience is going 
to mean a more critical use of lecture materids, with a clearer dis- 
tinction between what the student might best learn for himself with 
suitable guidance and what he can learn best from an organized lecture. 

Below is the way another programer evaluated programing: 

Tliis has been very stimulating to me. The developmental testing alone 
has provided much new “food for thought” on the problems of teach- 
ing and learning. The difficulties encountered by the students trying 
out my program have shown me some large faults in what I had as- 
sumed to be acceptable teaching methods. Tliese experiences and the 
technical information supplied at the two workshops make me feel that 1 
have learned a great deal which will be very useful to me profaionally 
even if I do not develop into a good program writer. 
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Here is another answer: 

Fve been dismayed at how easy it is to beg the question in organizing 
the present^oiion of a body of information, and delighted to see how 
students respond to a mode of analysis that programing demonstrates 
very effectively. On the one hand, I find it hard to be clear and to 
arrange for an “organic” development through a batch of material; 
on the other hand. I’m put o£E by how slow and repetitious have been 
the three or four published programs I’ve worked on. I’m becoming 
interested especially in the next step after programing — a step toward 
identifying students’ modes of working and then helping them capital- 
ize on their mode as well as practice “alien” modes. 

One last example: 

Its strongest impact has been on how I think through a problem and, 
through that effect, onto my sensitivity to how students may be work- 
ing on a problem. Fm less eager to “cover” a body of material and 
more eager to help a student hit his stride in discovering the order and 
the nature of the material. 

On another occasion, programers were sent a follow-up questionnaire 
asking them to evaluate their experience in preparing programed material 
as they looked back on it from the vantage point of nine months. The 
answers were categorized and are reported below. 

1. Programing forces systematic thinking about the teaching process. One 
programer said that programing was good for saying exactly what he 
wanted to say. Another mentioned that programing gave him insight 
into creating detailed materials. Still another said that he was forced 
to think more systematically about teaching. Another became thorough- 
ly persuaded that the material he had worked on was programable, 
whereas previously he had wondered whether it was. Still another re- 
ported that he became aware of the necessity of careful planning in all 
areas of teaching. 

2. Teachers became more aware of the necessity of formuUrtmg course 
objectives. One person mentioned that programing helped him set up 
goals for all his teaching; another seemed to become more conscious 
of course objectives. StiU another put it this way, “What can be tested 
can be programed.” Constructing a program gave another programer a 
clear sense of what he wanted to accomplish. 

3. The value of feedback from students. The programer suggested the 
value of thoughtful student evaluation of the materials. Another said, 
“Field testing showed me the value of detailed feedback from students.” 
Still another said that programing gave him better understanding of 
how a student’s mind works — ^“I would not have known the difficulties 
had I not tried to program.” Still a fourth programer mentioned that he 
was prompted to reconsider the contact time that he had with students. 

4. Application of programing principles to other areas of teaching. 

A programer reported that he had revised his lab exercises along lines 
of the linear program. Another mentioned that he had tried out dif- 
ferent use of lecture time. A third mentioned that, “ I am more 

critical about use of class period and testing procedures.” 



5. Insights into the learning-teaching process. A programer said that he 
is now more patient with the learning process after having developed a 
program and tried it out on students. Another indicated that prepar- 
ing a program had made him aware of how concepts can best be put 
across. Still another programer mentioned that writing test frames 
helped him write exam questions which really distinguished students 
who have attained the objectives from those who have not. 

To establish more scientifically the relationship between preparing 
programed materials on the one hand and other aspects of teaching on the 
other, a more formal study was designed, using systematically collected 
data. 

An attempt was made to answer the following questions: 

1. Does preparing programed materials, as outlined in a previous section, 
influence the programer’s concept of teaching? 

2. Is it possible to identify assumptions about selected aspects of teaching 
which differentiate programers from non-programers? 

3. Using the assumptions as criteria, can independent judges reliably dif- 
ferentiate statements about selwted aspects of teaching made by pro- 
gramers from statements made by non-programers? 

4. Specifically, what assumptions held by programers differentiate them 
from pon-programers and which concepts held by non-programers 
differentiate them from programers? 

Drawing on answers previously given by programers, the director 
made the following nine assumptions about the impact of programing on the 
programers’ thinking about and attitudes toward teaching. 

1. In preparing programed instructional materials the methods of instruc- 
tion acquire more value relative to content than is usually ascribed to 
them by college instructoi^. 

2. Formulating objectives in explicitly behavioral, objective, operational 
terms (in terms of outcomes of student behaviors) is a cardinal prin- 
ciple of programing. 

3. An important principle of programing is that students should be tested 
in teims of progress in attaining the objectives of the program. 

4. Analysis of materials to be programed is related to and grows out of 
objectives of the program, and material to be programed is to be organ- 
ized empirically and pragmatically in terms of the students’ ability to 
deal wiA it. 

5. Testing of students’ knowledge of the material prior to the students’ 
starting the course and to reorganize the content and methods of the 
course in the light of what he discovers about students’ previous 
knowledge. 

6. - Students need to be actively and r^ponsively engaged in learning; 

their activity improves not only their learning, but also provides fe^- 
back to the programer about the strengths and wealmesses of his 
program. 
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7. The material itself must be intrinsically motivating, since the pro* 
gramer cannot count mainly on interpersonal relationships with students 
to motivate them. 

8. The purpose of testing students is not only to evaluate the progress of 
the students toward the objectives of the program, but also to give, the 
teacher data with which to revise his assumptions about students’ 
knowledge, the level of difficulty of the content, and the sequence of 
the materitd. 

9. After having been trained in programing principles, and having pre* 
pared a program, the programer will be (a) more likely to use new 
instructional media in his teaching, (b) favorably disposed toward 
their use, (c) know how to use them discriminatingly, and (d) be in* 
formed about them. 

Twenty*four subjects were interviewed in the study, twelve of whom 
were 1965 GLCA programers and twelve of whom were the control group, 
selected by the deans to match each of the programers. The interviewer did 
not know which interviewee had prepared programed material and which 
had not. The questions in the interview allowed the respondents to talk 
about their concepts and practices of teaching in rdation to each of the 
nine assumptions; but they did not know what the assumptions were. 

The interviews were tape recorded. In addition, the answers of the 
respondent were summarized in written form by the interviewer who asked 
eacn respondent, at the end of the interview, to go over the written answers 
to make sure that they contained an accurate statement of his thoughts. 
The interviev/er’s answers were typed, coded, and assembled in random 
order into answer booklets. Each booklet contained all the answers to one 
question. 

The assumptions were stated as criteria so that each judge could rate 
each answer on the degree to which it expressed the same idea about teach* 
ing as did the assumption. Three judges who did not know the programers 
but were acquainted with the principles and techniques of programing 
spent two days in training and then independently judged the respondent’s 
answers in terms of how well they fit the assumptions. Each answer was 
rated on a five point scale from best fit to least good fit. 

The rating of each judge of each answer was recorded. The scores 
were statistically analyzed to ascertain the extent to which the programers’, 
more than the non*programers’, thinking about teaching fit the assumptions 
and also which assumptions most clearly differentiated programers from 
non*programers. Programers scored significantly higher than non*pro* 
gramers, indicating that their answers conformed more to the assumptions 
than did those of the non*programers. In addition it was possible to identify 
three assumptions which most clearly differentiate pfogramers from non* 
programers. 

Programers more than non*programers, believed that: 

1. (assumption 9) Having prepared a program, a programer is likely 
to use new instructional media in his teaching, be favorably disposed 
to their use, know how to use them discriminatingly, and be informed 
about them. 
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2. (assumption 2) In pireparing programed instructional materials the 
methods of instruction acquire more value relative to content than is 
usually ascribed to them by college instructors. 

3. (assumption 4) Analysis of materials to be programed is related to 
and grows out of objectives of the program, and material to be pro- 
gramed is to be organized empirically and pragmatically in terms of 
the students’ ability to deal with it. 

The other assumptions did not statistically distinguish the programers 
from the non-programers. 

Summary and Conclusions 

This pilot study strongly suggests that preparing programed materials 
changes and expands the programer’s concept of teaching. Progiaming 
promises to he a significant procedure for analyzing and improving some 
important aspects of teaching; especially those having to do with newer 
media, methods and empiric^Iy analyzing content. But the door has just 
been opened. Many large areas of the total teaching-learning process re- 
main to be investigated and developed via the preparation of programed 
instructional materials. 

Further sustained and more rigorously controlled research needs to be 
conducted to ascertain which aspects of teaching are most influenced by 
programing and the point at which further programing no longer produces 
new insights into teaching. What needs to be done to help teachers trans- 
late and generalize their new insights into teaching to their actual class- 
room behavior is still open for further inv^tigation. Such research will help 
determine the future role of preparing programed instructional materials 
in the total pre-service in-service education of college teachers. 
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EVALUATION OF COMMERCIAL PROGRAMS 



An original objective of the project was to review and evaluate com- 
mercial programs that were available in 1963. On sever^ occasions the 
project director provided the opportunity for faculty members of GLCA 
colleg^ to examine, use, and evaluate commercial programs. For example, 
early in the project, the director sent out a list of materials that were avail- 
able in his office to the Liaison persons for distribution to the department 
chairmen. During the Winter Work Con^erence of 1964', all available com- 
mercial programs were displayed, and in May of 1964, the director dis- 
played them again for a day on each campus. 

Faculty members generally paid little attention to the commercial pro- 
gramed materials. Their indifference was not wholly unexpected. By no 
means were all the available 150 commercial programs of college level 
quality. Some of the faculty members indicated that the only way they 
could use the programs that were available in their field would be as 
remedial programs. The greatest concentration of programs was in the 
field of mathematics. The sciences were the next b^i represented of the 
disciplin^. Modem foreign languages were the third. Only a few programs 
were available to the rest of the disciplines. 

By the end of the first year of the project, a total of fourteen faculty 
members had agreed to evaluate an off-the-shelf program in one of their 
classes during the 1964-65 school year. Each of the professors who evalu- 
ated one of the commercial programs also responded to an evaluation 
questionnaire. The questions were designed to sample the instructor’s at- 
titude about the value of the program as a teaching device. 

A tabulation of the questionnaries revealed that two-thirds of the in- 
structors thought the programs actually taught what they were presumably 
designed to teach. About one-third of the instructors found errors in the 
content of the program. Two-thirds of the instructors said the program 
saved them tinie; one-third were uncertain or said it did not save them 
time. The same ratio existed in the answer to the question of whether the 
content covered in the program justified the amount of time required by 
the student. The programs were considered rather expensive; less than 
half of the instructors thought the program was justified in terms of the 
cost. Only half of the instructors had a very positive experience with the 
commercial programs or expected to use similar material again. The others 
were divided between feeling somewhat more positive than negative to- 
ward the program and feeling more negative than positive. 

An analysis of the achievement of the students who used the program 
revealed no over-all pattern of success or failure of the programs. The 
success or the failure to teach seemed to be related specifically to each 
pro^am. Where tSie pro^am was generally considered to be a good one, 
the instructors evaluated it positively and students learned from using it; 
where the pro^am was poor, the results of the evaluation v/ere negative. 
But no conclusions could be drawn about programs in generaL 
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In addition, the relative lack of control on the evaluation procedures 
made it difficult to draw any firm generalizations about the value of com* 
mercial programs. The results indicated that each instructor who is con° 
sidering using programed materials needs to try out the program in his own 
classroom in order to assess its value to him. 



CONCLUSIONS 



In light of the total project, it can be concluded tihat: 

1. Professors in GLCA colleges can prepare high quality programed 
materials although it is a time consuming process. 

2. Good, short, single topic programs can be successfully used as in> 
structional devices in all three major areas of the curriculum. Students 
learn from them, faculty and students generally rate them prsitively. They 
provide a way of making college teaching more varied and flexible. They 
teach as well or better than other usual methods of instruction. Although 
the results of the evaluation of commercial programs were 1^ clear and 
positive, it is likely that the same conclusion holds for high quality com* 
mercial programs. 

3. Different programs succeed for different reasons and the variables 
accounting for success can be sorted out for each program. 

4. Preparing programed materials holds promise as a significant 
procedure for analyzing and improving some aspects of teaching and pos* 
sibly as an in-service education procedure. 

5. The project demonstrated the feasibility and value of having an 
association of colleges rather than a single institution carrying out a 
project such as this one — ^preparing and evmuating programs, stud^ng the 
broader effects of programing, and disseminating information about in- 
structional matters. 
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APPENDICES 



APPENDIX A 
LIAISON COMMITTEE 

A Li£uson Committee was formed early in the life of the project. The 
Liaison Committee performed yeoman service to the project in keeping 
faculty members informed of the process of the project and advising the 
director of currents of opinion and dWelopments on the campus witib re- 
spect to the project. The Liaison Committee met five times during the 
course of the project, three times in the first year and once in each of the 
two subsequent yeofs. Members of the Liaison Committ^ were: 

Albion College 

Dr. Paul Carnell, Chairman — ^^epartment of Cheraistry 
2nd and 3rd years— Dr. Dean Dillery, Dq>&. of Biology 

Antioch College 

Dr. Robert MacDowell, Associate Professor Mathematics 
3rd year— Professor Richard Meislar, Dept, of Philosophy 

Denison University 

Dr. Irvin Wolf, Professor of Psychology 

DePauw University 

Dr. Clark Norton, former Director of Graduate Studies; 

Asst. Dean of the University, Professor of Political Science 

2nd year — Dr. Kenneth Wagoner, Chairman, Dept, of Psychology 

Earlham College 

Dr. Daniel Smith, Assistant Proieecor of Education, 

Ccxirdinator of Self-Instruction 

Hope CoUege 

Dr. Ralph Perry, Professor of Romance Languages Department 

Kalamazoo CoUege , 

Dr. Walter W. Waring, Chairman — Department of English 

Kenyon CoUege 

Dr. Bruce Haywood, Dean of the College 
Oberlin CoUege 

Dr. Loche Van Atta, Associate Professor of Psychology 
Ohio Wesleyan University 

Dr. Francis Alter, Chairman — ^Department of Education 
3rd year — Dr. Joseph Wetmore, Professor of Education 

Wabash CoUege 

Dr. Paul Mielke, Associate Professor of Mathematics 
CoUege of Wooster 

Dr. Donald G. Beane, Assistant Prof^sor of Education 
3rd yeor— Dro Sam Cho, Department of Psychology 
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APPENDIX B 

DESCIHPTION OF PROGRAMS PRODUCED ON THE 
PROJECT IN 1964 AND 1965 

The following programs were produced in 1964 £ 

TECHNICAL FILMS ON BASIC PRINTMAKING TECHNIQUES, Paul 
Arnold, Department of Art, Oberlin College, Oberlin, Ohio 
General Objectives: To break down the basic techniques of intaglio 
printmaking into component steps, each of which is covert clearly and in 
detail in a loop film which can be projected easily by the student when he 
needs the information. The films eliminate the necessity for repeated 
individual explanations asid demonstrations. 

GERMAN VOCABULARY THROUGH COGNATES, Robert Brewster, 
Department of German, Earlham College, Richmond, Indiana 
General Objectives: To provide the beginning student of German with an 
active vocabulary of 200 words, over-learned visually and aurally, and 
To have the student learn inductively ten of the main consonantal relation- 
ships between English and German through these 200 word examples, and 
To help the student recognize new German wofds on the basis of these 
consonant^ laws. 

POETRY, METHOD AND ML^^MJNG: A PROGRAM IN POETIC 
ANi\LYSIS AND CRITICISM, James W. Cook, Department of English, 
Albion College, Albion, Michigan 

General Objectives: Student should use critical vocabulary when writing, 
thinking, or talking about poetry. 

Student should identify figure of speech and thought when they occur in 
a poem. 

Student should be able to analyze and specify the contribution of figures of 
speech and thought to a poem’s meaning. 

Student should be able to posit multi-level interpretations of a poem. 

ANALYTIC GEOMETRY: THE LINE, Thomas A. Davis, Department of 
Mathematics, DePauw University, Greencastle, Indiana 
General Objectives: This program is designed to be used in a college level 
course on analytic geometry and calculus or a text in cdculus. Students 
taking these courses have a wide range of previous training. This program 
will allow each student to spend as much time on each topic as he needs, to 
learn the material he does not know. 

A PROGRAM ON CRYSTAL STRUCTURE, Ansel M. Gooding, Depart- 
ment of Geology and Soil Science, Earlham College, Richmond, Indiana 

A SELECTED INTRODUCTORY ORGANIC CHEMISTRY PROGRAM, 
Peter J. Hawkins, Department of Chemistry, Oberlin College, Oberlin, Ohio. 

CONSTRUCTING THE UNIT CARD FILING IN THE LIBRARY 
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PUBLIC CATALOG AND SHELF LIST 
CHOICE OF MAIN AND ADDED ENTRIES 
CHOICE OF SUBJECT HEADINGS 

CLASSIFICATION, J. McKee Elrod, Library, Ohio Wesleyan University, 
Delaware, Ohio. 

General Objectives: To prepare library clerical and sub-professional 

personnel to perform a higher level of technical processing functions as 
listed in the titles of the programs; to allow the library school teacher to 
teach these clerical and sub-professional functions outside the regular 
cla&sroom. 

CAPITAL BUDGETING, METHODS OF RANKING PROJECT PRO- 
POSED FOR INVESTMENT, Vant W. Kebker, Department of Economics, 
Ohio Wesleyan University, Delaware, Ohio 

General Objectives: To help students understand why the method of dis- 

counting expected cash flows of income is better than other methods evaluat- 
ing and ranking proposals that involve investment of capital. 

A PROGRAM OF SELF INSTRUCTION IN SOCIAL ORGANIZATION, 
Richard Knudten, Department of Sociology, Newberry College, Newberry, 
South Carolina. 

LIBRARY OF CONGRESS CARD ORDER ROUTINE, Peter Kidder, 
Library, Kenyon College, Gambler, Ohio 

General Objectives: The program is designed to prepare people to do 
preliminary bibliographic searching in connection with ordering LC cards; 
order them; check them in, and do necessary foliow-iip work. 

HUMAN NATURE, Clarence Leuba, Department of Psychology, Wright 
State University 

General Objectives: To enable the student to answer certain specific 

questions regarding what human nature is and is not, and regarding the 
characteristics making up human nature. 

THE SOIL: A PROGRAMED TEXT, W. M. Lotkowski, Department of 
Earth Sciences, Antioch College, Yellow Spring, Ohio 

General Objectives: To enable a student to answer such * questions as: 
What is soil and how is it formed? How do temperature, humidity, com- 
position of underlying rock material, vegetation, topography, time, and 
land use aflest soil? Of what use are particular soils, and how can they be 
used most effectively? 

FORMAL STRUCTURE OF THE SHORT STORY, Kenneth B. Marshall, 
Department of English, Denison University, -Granville, Ohio 

General Objectives,: To train students to perceive funciion, within a short 
piece of fiction, of certain formal elements of structure: plot, character, 
narrative technique and attitude (including irony and use of symbol). 

PERSONNEL SELECTION: A SELF-INSTRUCTIONAL PROGRAM, 
F. S. McKenna, Dept, of Psychology, DePauw University, Greencastle, Ind. 
General Objectives: To provide a self instructional and self contained 
unit on the fundamental concepts and techniques of personnel selection. 
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Upon completion of this program, the student would be expected^ to be able 
to read the professional literature in this field with understanding and to 
develop systematic personnel selection procedures. 

THE LITERARY RELATIONSHIPS AMONG MATTHEW, MARK, 
AND LUKE, R. M. Montgomery, Department of Religion, Ohio Wesleyan 
University, Delaware, Ohio 

General Objectives: Having completed the unit and given material 
selected from Matthew, Mark, and Luke, the student should be able to 
identify the evidence supporting the theory that (a) Matthew and Luke 
used Mark, and (b) Matthew and Luke did not depend upon each other 
but upon an unknown source in their material which does not come from 

AN INTRODUCTION TO SYSTEMATIC ANALYSIS OF POLITICAL 
SCIENCE, Lois M. Pelekoudas, Department of Political Science, Antioch 
College, Yellow Springs, Ohio 

General Objectives: To identify and to state a problem in political science, 
identify hypotheses and assumptions, to frame hypotheses, and to identify 
major approaches in works of political science. 

THE LANGUAGE OF LOGIC, Morton Schagrin, Department of Physical 
Science, Denison University, Granville, Ohio 

General Objectives: To prepare students with no back^ound in modern 
logic with sufficient familiarity to read with comprehension recent studies 
in the philosophy of science and semantics which are written in this 
notation. 

HEARING MUSIC WITH UNDERSTANDING, Paul Schwartz. Depart- 
ment of Music, Kenyon College, Gambler, Ohio 

General Objectives: An introduction to elements of music through sight 
and sc;und; a text, consisting of 9 chapters, with tapes accompanying each 
chapter. 

INTRODUCTION TO THEORY AND SUBJECT MATTER OF ECON- 
OMICS, Fred S. Silander, Department of Economics, DePauw, University, 
Greencastle, Indiana 

MUSIC: BEGINNING EAR-TRAINING, L. R. Smith, H. B. Ray, R. A. 
Hammar, Department of Music, Kalamazoo College, Kalamazoo, Michigan 

General Objectives: To develop basic listening skills (Perception of in- 
tervals and rhythmic Patterns) . 

BIOCHEMISTRY FOR BIOLOGISTS, William K. Stephenson, Department 
of Biology, Earlham College, Richmond, Indiana 

General Objectives: Students will attain the chemistry and biochemistry 
requisite for the first course in contemporary college biology. 

PROGRAMED GERMAN READERS, Guy Stern, Department of German, 
University of Cincinnati, Cincinnati, Ohio. 

STUDY HABITS, F. P. Van Eyl, Depe tment of Psychology, Hope College, 
Holland, Michigan 

General Objectives: To develop study habits that lead to a more successful 
way of studying textbooks. 
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PUBLIC SCHOOL FINANCE, J. N. Wetmore, Department of Education, 
Ohio Wesleyan University, Delaware, Ohio 

General Objectives: . To teach undergraduate students all aspects of public 
school finance — ^local, state and federal. 

THE NATUFl^ AND USES OF COLOR, Forbes Whit^ide, Department of 
Art, Oberlin jllege, Oberlin, Ohio 

General Objectives: To teach and help the student gain familiarity with 
the interactions between hue, value and intensity. 

BIRD SONGS, James B. Cope, Department of Biology, Earlham College, 
Richmond, Indiana 

General Objectives: To teach students bird songs with the use of audio 
and visual aids. 

ORGANIZATION OF THE LIBRARY, Evan Farber, Library, Earlham 
College, Richmond, Indiana 

General Objectives: To train sub*professional help in library organization 
and entries. 

The following programs were produced in 1963: 

A PROGRAM IN COMPOSITION, Fred L. Bergmann, Department of 
English, DePauw University, Greencasde, Indiana 

General Objectives: To enable the student to recognize and to write ef* 
fective paragraphs through recognition of the basic principles of unity, 
coherence, and esiipliasis. 

FACT AND FORM; ELEMENTARY PRINCIPLES OF SENTENCE DE- 
SIGN, Owen Duston, Department of English, Wabash College, Crawfords* 
ville, Indiana 

General Objectives: To enable the student use the resources of sentence 
structure to organize the facts of his experience. 

A PROGRAMED INTRODUCTION TO SARTE’S ANALYSIS OF FREE* 
DOM, Robert Fichter, Department of Religion, Ohio Wesleyan University, 
Delaware, Ohio 

General Objectives: Find the rule which governs talk about Freedom, and 
Apply the rule to talk about Freedom. 

PASO A PASO, A BASIC COURSE IN SPANISH THROUGH MEAN* 
ING AND STRUCTURE, Renato J. Gonzales, Department of Spanish, 
Albion College, Albion, Michigan 

General Objectives,: To teach introductory Spanish, more specifically to 
train the student in the basic elements of Spanish by directly interacting 
with the languages without recourse to traditional grammar or translation 

skin. 

ALTERNATIVE LOGICS, L. H. Hackstaff, Department of Philosophy, 
Wabash College, Crawfordsville, Indiana 

General Objectives: To teach undergraduate studei^tQ seveml alternative 
systems of propositional logic. 

LABORATORY SUPPLEMENT FOR CHEMISTRY 11 AND 12, Alfred 
Hetiiderson and Laurence Strong, Department of Chemistry, Earlham Col* 
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lege, Richmond, Indiana 

General Objectives: To introduce students to an experimental study of 
interaction among die compounds of a mixture. The students see how con- 
tinuous variation experiments can provide quantitative data suit^le for 
establishing chemical equations. He also learns to test the humidity of 
proposed chemical equation by designing his own continuous variation 
experiment. 

MUSICAL RHYTHM (METER, PARTS A, B, AND C), Leonard Holvik, 
Department of Music, Earlham College, Richmond, Indiana 
General Objectives: To bring students to a conunon level for discussion 
of rhythm and related matters in the classroom — to give them command of 
the verbal material and concepts and of the actual musical phenomena 
concerned. 

THE ECOLOGY OF PUBLIC ADMINISTRATION, WiDiam L. Morrow, 
Department of Political Science, DePauw University, Greencastle, Indiana 
General Objectives: To help the beginning student of public administra- 
tion attain a realistic perfective of the nature of administration in general. 

INTRODUCTION TO MODERN PHYSICS, B. R. RusseU, Department of 
Physics, College of Wooster, Wooster, Ohio 

General Objectives: To present certain key topics in modern physics in 
a form suitable for use as supplementary material in a beginning college 
physics course. 

A PROGRAMED REFERENCE GRAMMAR FOR ELEMENTARY 
SPOKEN AND WRITTEN FRENCH, Richard R. Strawn, Department of 
Romance Languages, Wabash College, Crawfordsville, Indiana 
General Objectives: To state the grammar rules for each topic treated 
and to apply the rules correctly, on pape^% to new instances. 

CRYSTALS: AN INTRODUCTION— A PROGRAMED LABORATORY 
AND INDEPENDENT STUDY UNIT, John F. White, Department of Earth 
Sciences, Antioch College, Yellow Springs, Ohio 

General Objectives: To provide a stimulating and efficient programed 
study unit on crystals for introductory courses; 

To present the material so it can be useful for both science and non-science 
students; 

To provide for the integration of material that is ordinarily presented 
separately through lectures, text, and laboratory. 

ELECTROPHYSIOLOGY OF NERVOUS TISSUE, Francis W. Yowi De- 
partment of Biology, Kenyon College, Gambler, Ohio 
General Objectives,: Use and tlieory of Stimulator — Oscilloscope Complex 
and Interpretation of Oscilloscope Image with respect to transmition of 
nerve impulse. 
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APPENDIX C 



FACIJLTY MEMBERS WHO EVALUATED 
GLCA PROGRAMS 



The twenty-four studies included in the evaluation of the five GLCA- 
produced programs were conducted on the campuses of nine colleges, eight 
of which were Great Lakes colleges. Twenty-six professors participated 
in the evaluation of the programs. They were the following: 



Daniel Anderson 
Philosophy Department 
Ohio Wesleyan University 

Thomas Boyle 
English Department 
Albion College 

Philip Church 
English Department 
Kenyo n C ollege. ^ 

Robert Johnson 
English Department 
DePauw University 

Mrs. Sue McNaghton 
Department of Government 
Denison University 

Roy Morey 

Department of Government 
Denison University 

Morton Schagrin 
Department of History 
and Sciences 
Denison University 

William Richard Stegner 
Religion Department 
Illinois Wesleyan University 

Jerry Stone 
Religion Department 
Illinois Wesleyan University 

Brad Angell 
Philosophy Department 
Ohio Wesleyan Univ^sity 

T. R. Burkett 

English Department 
Denison University 

Robert DeHaan 
Education Department 
Hope College 

WiUiam Judd 
English Department 
Ohio Wesleyan University 



Ray Mizer 
English Department 
DePauw University 

Wendall Patton 
Zoology Department 
Ohio Wesleyan University 

Lee Scott 

Philosophy and Religion 
Department 
Denison University 

William Stephenson 
Biology Department 
Earlham Collie 

Jerome Tovo 
Philosophy Department 
College of Wooster 

Phillip Van Eyl 
Psychology Department 
Hope College 

Charles Weis 
En^ish Department 
Ohio Wesleyan University 

Louis Wilcox 
Biology Department 
Earlham College 

Fred Wirt 

Department of Government 
Denison University 

Melvin Vulgamore 
Religion Department 
Ohio Wesleyan University 

William Westbrook 
Economics Department 
Denison University 

Vannie Wilson 
Biology Department 
Denison University 

Frank Yow 
Biology Department 
Kenyon College 
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APPENDIX D 

Summary of Results of Analysis of Variance by Program and Design 



i 





Poetry 


Logic 


Biochemistry 


Religion 


Pol. Science 




Mizer- 

Johnson 

Lng*** 

Pvs.Ll 


Anderson 

Lng*** 

P»T 


Stephenson- 

Wilcox 

Lng*** 

P>L** 
P> T** 


Vulgamore 
Lng*** 
P> L* 


Wirt 

Lng*** 

P»L 


Design 

#1 


Church 

Lng*** 

P=L 


Angel! 

Lng *** 

P = T 


Yow 

Lng*** 
P> L*** 


Stegner 

Lng*** 

P = L 






Judd-Weis 

Lng** 

P = L 


Van Eyl 

Lng*** 

P= T 








Design 

#2 


Burkett 
Lng*** . 

P+Ds=P-|-L 


DeHaan 
Lng*** , 

P+D=P+L 


Strahenson- 

Wilcox 

Lng*** 

P + D = P4- L 
= P+D(mixed) 


Scott 
Lng*** 
P-I-DV8P+ LI 


McNaghten 

Lng*** 

P-FD = P*HL 


Design 

#3 


Boyle 

Lng*** 

P-l- L-L+P 


Schagrin 
Lng *** 
P-|-L*L-|-P 


Patton 

Lng *** ^ 

P + L=L4-P 


Stegner-Stone 

Lng*** 

P + L=L+ P 


Morey 

Lng*** 

P + L=L-1"P 


Design 

#4 




Tovo 

Lng *** 

P=L 


Wilson 
Lng *** 
P = L 




Westbrook 

Lng*** 

V=NV 



Key: Lng — ^Learning as measured by differences between pre and post test scores 

P— Programed materials 
L — ^Lectures 

T — ^Text materials V Eg., P > L means that program 

D — ^Discussion ( was superior to lecture. 

V — ^Volunteers 
NV — ^Non-volunteers 

= — No statistically significant differences 
• — P < .05 P, refers to the probability of the obtained 

•• — P^ .01 results having occured by chance; < .05 means 

— P< .001 that the probability is less than 5 in 100; 

<.01, less than 1 in 100; <.001, less than 1 in 1000. 



1 data not conclusive since groups not comparable due to si^ificant differences in 
means of pre-test scores. 



O 

ERIC 
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APPENDIX E 

Variance Accounted for by Variables lused in Computing Multiple R’s 





Program 




Poetry 


Logic 


Bio-Chem. 


Religion 


Pol. Sci. 


Percent of Variance 
Accounted for by 
Math, Verbal, and 
Pretest Scores 


15.98 


27.07 


1.35 


13.64 


18B9 


Percent of Variance 
Accounted for by 
Remaining Significant 
Variables 


15.35 


<> 

13.48 


10.80 


19.83 


12.83 


Total percent of Variance 
Accounted for by 
Multiple R 


31.33 


40.55 


12.15 


33.47 


31.72 
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